Multimodal Dialog System Using Hidden Information State Dialog Manager
نویسندگان
چکیده
This demo presents a multimodal dialog system that uses Hidden Information State (HIS) approach to manage the human-machine multimodal interaction. HIS dialog manager is a variation of classic Partially Observable Markov Decision Process (POMDP), which provides one of the statistical dialog modeling frameworks. But it has been hard to apply POMDP to the real domain of dialog system since POMDP-based dialog management requires very large size of state space. With HIS approach, system groups the belief states to reduce the size of state space, so that HIS dialog manager can be used in practical dialog systems. We adopted HIS dialog manager to our smart-home control domain multimodal dialog system that supports speech and pen gesture as input channels.
منابع مشابه
Collected papers on the PITA project
This paper describes the extension of the Alparon dialog manager to a broader domain and multiple modalities. To apply the dialog manager in the multimodal environment of the Personal Intelligent Travel Assistant (PITA), a multimodal coding scheme has been designed using dialog acts and XML. Additionally, the rigid database interface of the Alparon system has been replaced by a flexible and ada...
متن کاملInteractive Information Presentation by an Embodied Animated Agent
This paper illustrates the architecture of a multimodal believable agent, provided with a personality and a social role, aiming at providing information to users engaging them in a natural conversation. To achieve this aim, we provide our agent with a mind, a dialogue manager and a body: a) the mind, according to the agent’s personality, the events occuring and the user dialog move, triggers, i...
متن کاملMaking Sense of Partial ∗
We address the challenging task of processing partial multimodal utterances in a mixed-initiative dialogue system for multiple applications such as information seeking, device control etc. Based on four different types of expectations computed by our action planner (aka dialog manager), we distinguish between expected utterances, various degrees of unexpected but plausible utterances, and unint...
متن کاملContext-aware Dialog Strategies for Multimodal Mobile Dialog Systems
Multimodal mobile dialog systems face new challenges which do not exist in traditional spoken dialog systems. Amobile dialog system should provide robust task management during network loss, and intelligent assistance in new environments. To provide these capabilities, a system must sense changes in the user environment, and communicate them effectively to the user. In the field of human-comput...
متن کاملA multi-modal dialog system for a mobile robot
A challenging domain for dialog systems is their use for the communication with robotic assistants. In contrast to the classical use of spoken language for information retrieval, on a mobile robot multimodal dialogs and the dynamic interaction of the robot system with its environment have to be considered. In this paper we will present the dialog system developed for BIRON – the Bielefeld Robot...
متن کامل